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I.  Introduction. 


The  term  'sensitivity  testing'  applies  to  Bernoulli  experi¬ 
ments  in  which  the  outcome  of  each  experiment  is  a  quantal  response 
('O'  or  '1')  to  an  applied  stimulus  where  the  probability,  p(x), 
of  a  '1'  response  varies  with  the  stimulus  level  x.  Design  and 
analysis  of  sensitivity  tests  are  aimed  at  determining  properties 
of  the  response  function,  p(x). 

The  Probit  technique  for  sensitivity  testing  has  been  under 
development  for  about  a  century  (Finney  [7]).  This  technique  was 
initially  established  for  applications  in  the  area  of  bio-assay 
where,  for  example,  simultaneous  treatment  of  batches  of  insects 
by  different  levels  of  a  toxin  can  be  performed.  It  is  particu¬ 
larly  useful  when  the  experimental  program  can  be  designed  for 
simultaneous  multiple  trials  at  previously  specified  stimulus 
levels. 

Staircase  (Up-and-Down)  techniques  were  intro iuced  in  the 
last  twenty  five  years  (’jixon  and  Mood  [5]).  These  involve  sequen¬ 
tial  experimentation  which  is  usually  more  practical  than  batch 
testing  for  applications  such  as  failure  of  physical  structures  or 
electronic  components  subjected  to  stress,  ignition  of  combustibles 
subjected  to  heat,  and  detonation  of  munitions  or  explosives  sub¬ 
jected  to  shock. 

The  more  recent  technique  of  Stochastic  Approximation  received 
its  initial  impetus  from  the  search  for  efficient  procedures  for 
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estimating  the  stimulus  level  x  such  that  p(x)  =  a  (Robbins 
and  Monro  [12]). 

Of  primary  concern  in  much  of  the  literature  is  the  develop¬ 
ment  of  techniques  for  estimating  the  stimulus  level  x  «.  at 

•  J 

which  p(x)  =0.5  (Lethal  Dosage  50  or  LD50  in  bio-assay  termi¬ 
nology)  .  Estimation  of  standard  deviation  was  included  primarily 
for  the  purpose  of  making  confidence  statements  about  x  More 
recent  papers  recognize  the  standard  deviation  of  the  stimulus 
level  as  a  primary  sensitivity  measure  to  be  distinguished  from 
its  secondary  role  in  establishing  confidence  intervals  for  x  _ 

•  J 

(Gayle  [8]).  The  discussion  in  Section  III  illustrates  the  fact 
that  knowledge  of  x  ^  is  not,  in  general,  sufficient  information 
for  establishing  safety  and  reliability  of  a  system  nor  for  com¬ 
parison  of  those  factors  for  different  systems. 

Application  of  the  Probit  and  Staircase  techniques  require 
prior  knowledge  or  assumptions  by  the  investigator  for  the  speci¬ 
fication  of  the  location  and/or  spacing  of  the  applied  stimulus 
levels.  In  addition,  it  is  usually  assumed  that  the  stimulus,  or 
some  transformation  of  it,  obeys  the  normal  distribution  law 
(Bartlett  [2]  and  Garwood  [9]).  An  investigator  may  not  always  be 
willing,  or  able,  to  provide  these  inputs  without  some  preliminary 
experimentation.  The  modified  binary  search  procedure  proposed  in 
Section  IV  is  designed  for  this  preliminary  search  phase  with  the 
specific  intent  of  providing  a  basis  for  specification  of  the 


location  and  spacing  of  stimulus  levels  to  be  used  in  the  main 
experimentation  program.  The  proposed  search  procedure  is  intended 
as  a  prelude, to  rather  than  a  substitute  for ;  application  of  the 
Probit  or  Staircase  techniques.  It  could,  however,  be  used  for 
the  purpose  of  comparing  alternative  systems  when  the  experimenta¬ 
tion  is  severely  restricted  in  the  number  of  trials  that  can  be 
made.  The  possibility  of  using  this  technique  as  a  basis  for  an 
experimentation  procedure  for  the  subsequent  major  experimentation 
should  not  be  ignored  (Evans,  et  al  [6]). 

The  assumption  of  normality  has  been  the  subject  of  consid¬ 
erable  discussion  in  the  literature  (Anscombe  [1]).  Extensive 
experimentation  is  required  to  establish  the  appropriate  distribu¬ 
tion  for  applications  in  which  safety  and/or  reliability  are  of 
primary  interest  since  these  factors  involve  the  tails  of  the  dis¬ 
tribution.  In  the  vicinity  of  x  the  validity  of  the  assumption 

•  J 

of  normality  does  no*  appear  to  be  critical,  particularly  when  the 
experimentation  is  limited  to  small  samples  ([5]  p.  112  and  Tysver 
?L31).  In  the  analysis  accompanying  the  search  procedure  proposed 
in  Section  IV  and  its  extension  in  Section  V,  the  sample  srzes  used 
for  estimation  are  between  6  and  9  and  hence  the  assumption  of 
normality  is  considered  to  be  acceptable  for  the  stimulus  level 
itself  or  that  an  appropriate  transformation  (such  as  th?  logarithm) 
has  been  introduced  and  the  stimulus  levels  are  measured  in  this 


transformed  variable. 
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The  model  used  in  the  development  and  discussion  reported 
in  this  paper  is  presented  in  Section  II. 

II.  The  Model. 

Let  x  denote  an  applied  stimulus  level  (0  £  x  <  ®)  and 
y  =  y(x)  the  corresponding  auantal  response  ('O’  for  no  response 
and  ’1*  for  a  positive  response).  At  any  specified  stimulus 
level  the  response  will  be  considered  to  be  a  realization  of  a 
Bernoulli  random  variable  Y  with  the  response  probability 

p(x)  =  Prob  (Y  =  1  |  x). 

The  function  p(x)  is  called  the  response  function.  In  general 
we  will  have  p{0)  **  0  and  p(«)  *  1.  A  shorter  .interval  (a  £  x  £  b) 
with  Oia  <  b  <  «  can  frequently  be  considered  with  p(a)  ~  0 
and  p(b)  ~  1.  A  response  function  is  sketched  in  Figure  1. 


Figure  1.  The  Quantal  Response  Curve 
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Note  that 

Prob  (Y  *  1  |  x  <  a)  ~  0  and  Prob  (Y  =  1  |  x  ^  b)  ~  1. 

For  sensitivity  testing  applications  the  response  function  will  be 
continuous  and  monotonely  increasing  in  x.  Thus  p(x)  can  be 
considered  as  the  cumulative  distribution  function  for  a  random 
variable  X  with 

p (x)  =  Prob  (X  £  x) . 

The  random  variable  X  will  be  interpreted  as  a  threshold  stimulus 
level.  If  the  applied  stimulus  level  x  satisfies  the  inequality 
x  2:  X  where  X  is  the  applicable,  threshold  stimulus  level  in  a 
particular  experiment,  then  the  response  will  be  y=  1.  If  x  <  X, 
then  the  response  will  be  y  *  0.  Thus 

Prob  (Y  =  1  |  x)  =  Prob  (X  £  x)  =*  p(x) 

and 

Prob  (Y  =  0  |  x)  5  Prob  (X  >  x)  =  1  -  p (x) . 

In  conjunction  with  the  distribution  function  p(x)  there 
will  be  a  probability  density  function  f(x)  for  the  threshold 
stimulus  X  such  that 

x 

P (x)  =  j  f (u)du. 

0 
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Sensitivity  testing  differs  from  ordinary  random  sampling  in  that 
the  experimentation  provides  data  on  the  distribution  function 
instead  of  the  density  function.  More  specifically,  each  trial 
does  not  provide  an  observation  on  the  random  variable  X.  It 
only  establishes  whether  the  value  for  that  random  variable  is 
greater  or  less  than  the  applied  stimulus  level  in  that  particular 
trial.  Less  information  is  obtained  from  each  trial  than  would  be 
achieved  by  an  observation  on  the  random  variable  X  (the  thresh¬ 
old  stimulus  level) .  The  mathematical  form  of  the  density  function 
and  estimates  for  its  parameters  must  be  established  from  this  data 
on  the  distribution  function. 

For  the  analysis  of  the  search  procedure  described  in 
Sections  IV  and  V,  it  will  be  assumed  that  X  obeys  the  normal 
distribution.  Then 


p(x)  =  N(X  |  y,  a2) 

where  N(X  |  y ,  a2)  denotes  the  cumulative  normal  distribution 
with  mean  y  and  variance  a2.  In  Particular 

Prob  (X  £  y)  =  p(y)  *  N(y  |y,  a2)  =  0.5. 

Two  additional  concepts  will  be  used  in  the  next  section. 
One  is  that  of  a  ’mixed  response  region,’  (Golub  and  Grubb  i.V>]). 
If  a  stimulus  level  X  satisfies  the  inequality 


e  <  p(x)  <  1  -  e 
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for  reasonably  small  e,  then  x  is  said  to  be  in  the  region  of 
mixed  responses.  One  of  the  goals  of  a  preliminary  search  proce¬ 
dure  is  the  location  of  the  mixed  response  region.  The  other  con¬ 
cept  deals  with  the  experimental  evidence  indicating  when  stimulus 
levels  are  in  the  mixed  response  region.  An  'inversion*  will  be 
said  to  have  occurred  when  two  applied  stimulus  levels  x^  and 
x^  with  x^  <  x^  produce  responses  y(x^)  =  1  and  y(x^)  =  0. 

When  this  inversion  occurs,  both  x^  and  are  in  the  mixed 

response  region. 

III.  Safety  and  Reliability. 

Sensitivity  applications  can  be  divided  into  two  types  for 
safety  and  reliability  considerations.  The  first  type  includes 
detonation  and  ignition  applications.  The  second  type  includes  the 
bio-assay  applications.  These  are  described  below. 

The  firs',  tvpe  involves  the  resronse  of  a  subject  to  two 
different  stimulus  sources.  Let  ft(x)  denote  the  density  function 
of  the  threshold  response  stimulus  for  a  subject  (e.g.,  a  sample 
of  explosive  material) .  Let  f  (x)  denote  the  deus I ty  function 
for  the  signal  stimulus  applied  when  a  response  is  desired.  Relia¬ 
bility  considerations  involve  the  relationship  between  ft(x)  and 

f  (x).  Similarly,  let  f  (x)  denote  the  density  function  for  the 
s  n 

background  or  noise  stimulus  level.  Safety  considerations  involve 
the  relationship  of  f  (x)  to  f  (x) .  These  relationships  are 


illustrated  in  Figure  2. 


Figure  3.  Relationship  of  Signal  Stimulus  to  Host  and 
Parasite  Response  Thresholds  for  Bio-Assay 
Applications . 
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k  safety  measure  for  a  particular  application  can  be  estab¬ 
lished  as  follows.  Let 

x 

Ffc(x)  «  |  ft(x)du. 

0 


The  probability  that  an  undesired  response  will  occur  is  the 
probability  that  a  response  will  be  caused  by  noise,  i.e.. 


P(Y  *  1/noise)  *  [  F  (x)f  (x)dx. 

)  t  n 

0 

The  probability  that  no  undesired  response  will  occur  can  be  used 
as  a  safety  measure. 

S  =  1  -  P(Y  «  1/noise). 

This  represents  an  extreme  simplification  of  safety  considerations 
since  the  noise  stimulus  level  can  vary  with  time  and  such  factors 
as  the  method  and,  for  example,  the  extent  of  transportation 
of  an  explosive  material  prior  to  the  time  a  response  is  desired. 

In  a  similar  way,  a  reliability  factor  can  be  defined  as  the 
probability  that  a  response  will  occur  when  a  Signal  stimulus  is 
applied,  i.e. , 


R  «  P(Y  =  1/signal) 
00 

-  |  Ft(x)fs(x)dx. 
0 
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threshold  density  function  f ^ (x)  to  the  right  without  changing 

its  shape,  (increasing  y^)  the  safety  measure  will  be  increased. 

The  applied  signal  density  function  f  (x) ,  which  is  usually 

s 

subject  to  control  by  the  operator  or  engineer  in  charge,  must 

/ 

then  be  shifted  to  the  right  also  (increasing  yg)  to  prevent 
decrease  in  the  reliability  measure. 
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On  the  other  hand,  if  changes  can  be  made  to  reduce  the 

spread  of  f^Cx)  (reducing  ofc)  both  safety  and  reliability 

measures  could  be  improved.  An  investigator  should  be  interested 

in  establishing  the  effect  of  changes  on  as  well  as  on  y^. 

It  is  a  conjecture  of  the  author  that  changes  in  the  composition 

of  an  explosive  to  increase  y  will  also  increase  0t.  This 

increase  in  could  at  least  partially  counteract  the  gain  in 

safety  produced  by  the  increase  in  yfc  and  would  necessitate  an 

additional  increase  in  the  mean  y  of  the  applied  signal  to 

s 

maintain  the  reliability. 

IV.  A  Modified  Binary  Search. 

If  the  response  curve,  represents  a  step  function,  then  a 
simple  binary  search  for  the  location  of  the  step  would  be  appro¬ 
priate.  When  the  mixed  response  region  has  non-zero  width,  however, 
the  occurrence  of  a  *0*  ('1')  response  does  not  indicate  whether 
the  applied  stimulus  1s  below  (above)  or  in  that  region.  The 
binary  search  procedure  must  then  be  modified  to  provide  some  indi¬ 
cation  when  applied  stimulus  levels  are  in  the  mixed  response  region. 
Response  inversion  is  the  indicator  incorporated  in  the  proposed 
procedure  shown  in  the  flow  charts  (Figure  4)  and  described  below. 

Situation  S*  is  a  cyclic  one  indicating  that  a  reduction 
in  step  size  should  be  introduced.  The  procedure  aims  at  recon¬ 
struction  of  this  situation  at  each  cycle.  Failure  to  reconstruct 
S*  occurs  when  there  is  a  response  inversion  indicating  that  the 


o  o  I  0  I  # 


I )  u  i  o  !  c.  C 
— . — 


6  o  I  <»  1  /  s 

{ — I — j— I — 1 — »  J  : 


Q)  x>.  =  b  then  y„  =  1 


C§)  x1  =  a,  then  y 


1>  o  i  o  y  »  ^ 

•* — ' — ' — * — I — I  J  I 


*  a  *  o  )  i 


t.  Search  from  S* 


Figure  4.  Flow  Chart  for  Modified  Binary  Search 
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general  location  of  the  mixed  response  region  has  been  established. 
Trials  are  then  introduced  at  the  ends  of  the  basic  inversion 
situation  Sq  to  produce  the  terminal  situations  S^,  or 
(Figure  5).  Sy  and  are  upper  and  lower  boundary  situations, 

respectively.  Footnotes  in  Figure  4  indicate  that  the  proposed 
sequence  of  trials  could  indicate  trials  to  be  made  at  a  or  b. 
The  confidence  in  the  assumed  responses  (y(a)  *=  0  and  y(b)  *  1) 
by  the  investigator  should  indicate  whether  these  trials  are 
necessary . 

In  the  analysis  which  follows,  a  normal  distribution  will 
br  assumed  for  the  threshold  stimulus  and  trials  at  different 
stimulus  levei  s  will  be  assumed  to  be  independent.  Thus,,  for 
example,  the  probability  of  the  responses  in  situation  S*  is 

Prob  (S*>  =  Prob  (Y1  -  0,  Y?  «  0,  1'3  «  1,  Y^  =  ljx^x^x^x^) 

4 

=  n  Prob  (Yi  *  yjxj)  =  [1  ~  H(Xj)]ll  -  N(x2)]N(x3>K(x4) 

where 


and 


Prob  (Yj_  »  y.Jx^ 


/^N(x±)  if  y±  »  1 

'  1  -  NCx^  if  =  0 


N(x±) 


Prob  (X±  *  x^)  * 


e 


Figure  5  includes  the  situations  of  primary  interest 
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Maximum  likelihood  estimates  for  y  and  o  can  then  be  established 
using  tables  for  the  normal  distribution  for  each  of  the  terminal 
situations  (see  Golub  and  Grubb  [10]  and  Langlie  [11]).  Only 

A  A 

approximate  values  for  the  estimates  y  and  a  are  required  from 
the  preliminary  search  phase. 

It  may  be  of  some  interest  to  consider  a  general  situation 
S  consisting  of  n  trials  at  equally  spaced  stimulus  levels.  If 
y  is  within  the  sample  and  a  is  large  with  respect  to  the  sampi? 
width  then  the  responses  at  the  individual  stimulus  levels  are 
immaterial  since 


Then 


Prob  (Y  -  Ojx)  ~  Prob  (Y  -  l|x)  ~  0.5. 


Prob  (S)  ~  (0.5)n, 


Prob  (S*)  ~  Prob  (SQ)  ~  (0.5)4  -  0.0625, 


and 

Prob  (S1)  ~  Prob  (S .)  ~  Prob  (S3)  ~  (0.5)6  »  0.0156. 

The  analysis  for  S*  is  simple.  By  symmetry,  y  ■  +  Ax/2 

where  Ax  ■  xi  -  Also  Prob  (S*)  approaches  unity  as  a 

approaches  zero.  Thus  a  reduction  in  Ax  is  indicated  with  the 
region  of  mixed  responses  lying  between  x^  and  x^.  For  S^, 
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symmetry  also  holds  so  that  p  *  X2  +  Ax/2.  The  estimate  a  ~  1.6Ax 
together  with  p  gives  Prob  (Sq  ~  0.097,  which  is  not  substan¬ 
tially  greater  than  the  limiting  value  Prob  (Sq|o  »  Ax)  ~  0.0625. 
Prob  (Sq)  does  not  change  appreciably  with  substantial  changes  in 
p  and  a  as  shown  in  Table  1.  (This  could  be  anticipated  since 
only  4  trials  are  involved.)  Since  the  estimate  of  0  is 
greater  than  Ax,  additional  trials  should  be  used  in  an  attempt 
to  pin  down  the  ends  of  the  mixed  response  region  instead  of  re¬ 
ducing  the  step  size  further. 

A 

Situation  S^  also  involves  symmetry  so  that  p  *  x^  +  A: 72. 
Further,  o  =  1.3  Ax  and  Prob  (S^|p,o)  ~  0.089,  which  is  sub¬ 
stantially  larger  than  the  limiting  value  Prob  (Sq!?  »  Ax)  =  0.0156 
(see  Table  2).  S^  is  accepte 1  as  a  terminal  situation,  but  this 
should  not  preclude  an  investigator  from  taking  additional  trials 
to  improve  the  estimates.  Situations  S^  and  S^  are  similar  so 
only  one  need  be  analyzed.  The  estimates  for  S^  are 

p  ~  x__  -  and  a  ~  6  Ax 

For  S^  they  are 

*  Ay 

p  ~  x,  +  -7-  and  a  ~  6  Ax. 

—  o  4  — 

If  an  investigator  wishes,  previous  responses  to  stimulus 
levels  which  are  near  the  terminal  situations  can  be  included  in 
establishing  the  maximum  likelihood  estimates.  Trials  substantially 
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separated  from  those  in  the  terminal  situations  will  contribute 
little  to  the  estimates * 

V.  Extension  of  Search. 

The  limitation  in  Section  IV  to  the  responses  at  the  six 
stimulus  levels  of  S^,  S^  and  S^  for  the  estimation  of  ji  and 
a  appear  reasonable  for  many  applications  where  experimentation 
must  be  severely  limited.  For  the  purpose  of  comparison  of  fuels 
or  explosives,  some  investigators  may  consider  that  the  preliminary 
search  procedure  provides  sufficient  evidence  without  any  subsequent 
experimentation.  A  substantial  portion  of  the  literature  on  sensi¬ 
tivity  testing  is  devoted  to  sample  sizes  of  10  or  less.  If  the 
investigator  can  allocate  more  trials  to  the  preliminary  search 
phase,  the  proposed  search  procedure  can  be  easily  extended.  Some 
suggested  extensions  are  shown  in  Figures  6,  7  and  8. 

For  situation  S^,  the  ends  of  the  mixed  response  region 
appear  to  be  pinned  down  and  the  additional  stimulus  levels  should 
be  used  to  fill  in  between  the  levels  already  used.  Two  suggestions 
involving  3  or  5  additional  levels  are  shown.  Depending  on  the 
investigator’s  resources,  these  could  be  added  directly  as  indicated 
by  the  upper  and  lower  paths  in  the  diagram,  or  sequentially.  If 
the  sequential  path  is  chosen,  the  three  central  levels  are  used 
first  and  then  a  decision  is  made  whether  or  not  to  add  the  other 
two.  If  the  responses  to  the  first  three  are  (0,0,1)  or  (0,1,1) 
the  other  two  may  be  dropped.  However,  if  any  of  the  other  response 
sequences  occur,  the  other  two  should  be  used. 
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Figure  6.  Extension  of  Search 
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Figure  7.  Extension  of 
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The  suggested  extensions  for  -S^  and  are  motivated 

by  the  desire  to  pin  down  the  ends  of  the  mixed  response  region  by 
having  two  'O'  responses  at  the  left  end  of  the  sample  and  two 
'1*  responses  at  the  right  end.  If  the  responses  at  the  suggested 
sample  points  (indicated  by  x's  in  Figure  8)  do  not  produce  the 
desired  results,  additional  stimulus  levels  should  be  added  until 
this  result  is  achieved.  Deviation  of  the  actual  results  from  the 
desired  terminal  situation  is  an  indication  that  o  is  still 
larger  than  the  estimate  a  ~  6  Ax  for  and  S^.  Thus  no 

reduction  in  step  size  is  warranted.  On  the  other  hand,  if 
o  »  6  Ax  situations  and  have  low  probability  of  occurring 

and  the  suggested  search  procedure  will  usually  terminate  with  a 
large  Ax.  Estimates  of  p  and  o  are  included  in  Figures  7, 

8  and  9.  Responses  at  stimulus  levels  used  in  the  search  sequence 
will  have  yielded  'O'  responses  at  either  x^  or  x^  so  that 
situations  S9  and  S9  7  will  not  occur  when  those  responses 
are  considered.  This  will  reduce  the  number  of  trials  and  avoid 
repetition.  Some  possible  situations  where  the  extension  of 
could  include  stimulus  levels  previously  tested  are  shown  in 
Figure  10.  Figure  11  shows  a  possible  boundary  effect  situations 
affecting  extension  of  S^.  (The  latter  is  a  special  case  of  the 
situation  shown  in  Figure  10.) 
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1.  Start  with  S*  =  (0,0, 1,1)  at  (x^x^x^.x^) 

2.  Cycle  to  S*  at  (xg,x2,x^,x^) 

3.  Continue  to  Sg  -  (1,0, 1,0, 1,1)  at  (x^,xg,xg,x2,x7  x^) 

4.  In  Extension  of  S2,  first  point  is  XjLC=x1  s0  y1&=0 

0  _ 101011  1  1 

•  •  •  •  •  •  •  •  •  •  •  •  •  • 

X1  x9  x2  x8  x5  X7  x3  x6  x4 

1.  Start  with  S*  at  (xlfx2,x,,x^) 

2.  Cycle  to  S*  at  (x^x^.x-^Xg) 

3.  Continue  to  S2  at  (x^,x2,xg,x^,xy,x^) 

4.  In  Extension  of  S2,  third  point  is  x12=x^  so  y12=0 

Figure  10.  Extensions  of  S2  including  previous  levels 
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1.  Start  at  (a,b) 

2.  Cycle  to  S*  at  (x-^x^x^b) 

3.  Continue  to  S2  at  (x^x^x^x^x^xg) 

4.  In  Extension  of  S2,  first  point  is  x^=a  so  yy=yg=0 


Figure  11.  Extension  of  S2  overlapping  boundary 


VI.  Discussion. 


The  probit  method  of  sensitivity  testing  requires  specifica¬ 
tion  of  the  stimulus  levels  to  be  tested  as  an  input.  The  staircase 
technique  requires  an  initial  stimulus  level  and  a  constant  step 
size  in  stimulus  levels  between  successive  trials  as  an  input. 
Optimal  stimulus  level  spacing  depends  upon  the  distribution  of 
the  threshold  stimulus  and  is  related  to  the  standard  deviation 
of  that  random  variable.  The  staircase  technique  provides  some 
search  capability  for  locating  the  region  of  mixed  responses  but 
could  be  inefficient  either  for  the  search  or  for  the  estimation 
phases  of  the  investigation.  Step  sizes  which  are  large  in  compari¬ 
son  to  a  require  few  steps  to  locate  the  mixed  response  region 
but  have  poorer  capabilities  for  estimating  p  and  o.  On  the 
other  hand,  step  sizes  which  are  small  in  comparison  to  a  can 
require  many  trials  in  the  search  phase  if  the  initial  stimulus 
level  is  far  from  the  mixed  response  region.  A  technique  involving 
reduction  in  step  size  is  clearly  indicated  for  applications  in 
which  the  location  of  the  mixed  response  region  is  not  known  a 
priori  and  its  width  may  be  a  small  portion  of  the  region  to  be 
searched  [11]. 

In  specifying  the  stimulus  levels  for  testing  by  the  probit 
technique,  an  approximate  location  for  p  must  be  known  as  well 
as  the  approximation  for  a  required  for  sample  spacing.  Observa¬ 
tions  taken  outside  the  region  of  mixed  responses  contribute  little 
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to  the  quality  of  the  estimates  and  may  even  be  hazardous  (Berkson 
[12]).  Sample  stimulus  levels  for  use  with  this  technique  should, 
ideally,  span  the  region  of  mixed  responses.  Large  differences 
between  the  central  stimulus  .level  and  p  degrade  the  estimates 
(Brownlee  et  al,  [4]). 

The  assumption  that  the  logarithms  (or  some  other  specified 
transformation)  of  the  threshold  stimulus  levels  are  no  .mally 
distributed  provides  the  basis  for  the  probit  technique.  The 
literature  contains  considerable  discussion  of  this  assumption  and 
ways  to  fulfill  or  circumvent  it  (c.f.  [1]).  For  the  small  sample 
sizes  used  in  the  search  phase  proposed  in  this  report,  the  question 
of  normality  appears  somewhat  academic  and  normality  was  assumed 
for  the  analysis  in  Sections  IV  and  V.  More  appropriate  distribu¬ 
tions  may  be  used  for  subsequent  stages  of  experimentation. 

The  factors  of  safety  and  reliability  involve  the  tails  of 
the  distribution  for  the  threshold  stimulus  and  hence  are  highly 
dependent  on  the  mathematical  form  and  parameters  of  the  distribu¬ 
tion.  For  competitive  systems  wherein  it  can  be  assumed  that  only 
the  parameters  of  the  distribution  are  different,  measures  of  the 

A  A 

location  and  spread  of  the  distribution  such  as  p  and  a  can  be 
used  as  the  basis  for  comparison.  In  estimating  absolute  levels 
for  safety  and  reliability,  the  normal  distribution  could  be  used 
for  indicating  approximate  stimulus  levels  for  subsequent  experi¬ 


mentation. 
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The  extensions  to  the  modified  binary  search  suggested  in 
Section  V  are  included  so  that  an  investigator  can  add  trials  to 
improve  the  preliminary  estimates  of  p  and  a  givei  in  Section 
IV  if  his  resources  permit  and  if  his  resources  prohibit  a  more 
extensive  second  stage  of  experimentation:  The  results  of  this 
extension  also  provide  an  indication  of  the  value  of  the  extension. 

a 

For  example,  the  estimate  a  =  1.3  Ax  for  S^  will  be  replaced 

A 

by  the  estimate  a  =  Ax  if  the  extension  of  S^  leads  to  ^ 
and  by  a  =  2.75  Ax  if  the  extension  leads  to  S.  ,.  The  changes 

A 

in  o  by  extension  of  S£  and  S^  are  substantially  greater 
thus  indicating  even  further  extension  is  desirable  for  these 
situations.  The  relative  frequency  of  occurrence  of  and 
should  be  substantially  less  than  that  of  S^. 

Subsequent  investigations  should  include  a  study  of  the 

A  A 

potential  variations  of  ji  and  a.  Monte  Carlo  techniques  appear 
more  appropriate  than  an  analytic  approach  for  this  investigation. 
The  proposed  extensions  of  and  appear  minimal  and  further 

extension,  at  least  for  these  situations,  appears  desirable. 
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II*.  a»ON*ONIN»  MIUTARV  ACTIVITY 


'Trobit  analysis  and  the  ’staircase'^ technique  for  sensitivity  testing 
require  prior  knowledge  or  assumptions  to  provide  the  location  and/or 
spacing  of  stimulus  levels  to  be  used  in  the  experimentation.  A 
preliminary  experimentation  phase  using  a  modification  of  binary 
search  is  proposed  to  provide  the  input  information  necessary  for 
efficient  use  of  these  techniques.  For  applications  where  the  experi¬ 
mentation  is  severely  limited,  the  results  of  this  modified  binary 
search  can  be  used  for  the  purpose  of  comparison  of  the  reliability 
and  safety  of  competitive  systems.  _ 
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